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^ (57) Abstract: A means of navigating without localisation infrastructure or external control, an autonomous vehicle along a path 
that is confined by walls that are within range of on-board sensors by determining the relative location and orientation of the walls 
with respect to the vehicle, the m«»n< comprising means of controlling the vehicle, including setting steer angle and ground speed, 
without localisation comprising hardware and means to: (a) use range data to establish free space in front of vehicle; (b) use active 
contours (or snakes) to generate a desired path; (c) use driving hints to guide the or a said snake, for instance along arcs and open 
areas; and/or to (d) use steering hints to confine the snake to a specific domain of free space, for instance at intersections; and (e) use 

^ desired path to generate steering demand and velocity. 
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A SYSTEM FOR RELATIVE VEHICLE NAVIGATION 

FIELD OF THE INVENTION 
This invention relates to a system for relative vehicle navigation, 
and particularly relates to such a system for use in underground 
5 passageways or tunnels, for instance, an underground mine, and to control 
the movement of vehicles. 

The invention will be described with reference to remotely 
operated mining vehicles in an underground mine, but it should be 
appreciated that the invention need not be limited to this embodiment. 
10 BACKGROUND ART 

The underground mining environment is unstructured in a 
robotic sense but is topological^ highly structured. It consists of well-defined 
paths (tunnels with walls), intersections, muck piles and ore passes. 

The navigation of a vehicle in such an environment can be 
15 compared to the task of rally driving, where the navigation of the vehicle is 
shared between driver and navigator. The driver is concerned simply with 
moving the vehicle forward and staying on the road, whilst the navigator uses 
pace notes to sequence his/her attention for landmarks, and provide 
instructions to the driver about the path to take at intersections. 
20 In order to drive successfully, there is no need for precise 

absolute location data. The only time the location of the vehicle is needed is 
at intersections where a decision must be made. Fortunately, the very nature 
of these intersections make them easy to identify (coupled with odometry data 
and expectations from the map) and it is possible to reliably determine the 
25 position of the vehicle with respect to the intersection geometry. 

The advantage to this approach is that it is very tolerant to: 
changes within the environment; machine performance, i.e. changes to tyres 
and weight; and imprecise initialisation and map building. The interaction 
between the driver and navigator is shown in Figure 1. 
30 Traditional navigation systems are based upon an absolute 

frame of reference where the position of the vehicle is defined in terms of the 
distance with respect to an external frame of reference. This system will be 
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referred to as the Absolute Navigation System (ANS). 

In many situations, where the path of the vehicle is constrained 
by a wall, a far more suitable approach is a navigation system based upon a 
relative frame of reference. This system will be referred to as the Relative 
5 Navigation System (RNS). Figure 2 illustrates the main difference between 
the ANS and the RNS. 

In the ANS there is a predetermined path, in terms of the 
external coordinate system, for the vehicle to follow. If the vehicle strays from 
the path (by some offset) then a local path correction is applied to the vehicle. 

10 In the RNS, there is no predefined path, only some distant destination. The 
desired path of the vehicle is a local path that is generated to keep the vehicle 
from hitting the walls. Although these systems may generate a similar "vehicle 
path" the control systems used to generate these paths are quite different. 

Figure 3 illustrates vehicle control using the ANS. This system 

15 requires a map and a global-path. The map contains the position of 
landmarks used to help establish the location of the vehicle. Localisation is 
achieved by comparing the landmarks in the mine-map with data from 
position sensors (e.g. the position of reflective beacons) and fusing this 
information with dead reckoning. The position sensors can be reflective 

20 beacons which need to be placed at known positions in the mine. The global- 
path is a set of points, with respect to the external coordinate frame, that 
define a predetermined path through the mine. Local path planning is 
achieved by comparing where we are (x,y) with where we should be (x\y'). 
This tells us where we want to go. The correction (dx.dy) is fed into a 

25 kinematic model, which is coupled with the state of the vehicle (velocity, 
acceleration) to estimate a change in heading (da) and speed (dv). 

The ANS is effectively blind - the control of the vehicle is 
inferred from the position of the vehicle, rather than what the sensors tell it 
about the environment. If there is any error in the localisation then it is quite 

30 possible for the vehicle to collide with a wall. 
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It is an object of the present invention to provide a means to 
guide a vehicle in an underground environment which does not rely upon an 
ANS. 

In one form, the invention resides in a means of navigating 
(IEEE Dictionary: "The process of driving a vehicle so as to reach the 
intended destination"), without localisation infrastructure (this refers to 
infrastructure that is added to the external environment to help localise the 
vehicle; it can include active and passive beacons) or external control, an 
autonomous vehicle along a path that is confined by walls (the wall does not 
need to be real; it can be conceptual - it is simply a boundary between where 
the vehicle can and cannot go) that are within range of on-board sensors by 
determining the relative location and orientation of the walls with respect to 
the vehicle, the means comprising: 

Means of controlling the vehicle (setting steer angle and ground 
speed) without localisation comprising hardware and means to: 



(a) use range data to establish free space in front of vehicle, 

(b) use active contours (or snakes) to generate a desired path, 

( c ) use driving hints to guide the or a said snake, for instance along 
arcs and open areas, and/or to 

( d ) use steering hints to confine the snake to a specific domain of 
free space, for instance at intersections, and 

( e ) use desired path to generate steering demand and velocity. 

In a broad form, the invention resides in a method for navigating 



a vehicle, the method comprising creating active contours (or snakes) to 
generate a desired path for the vehicle, using driving hints to guide The or a 
said snake and/or using steering hints to confine the snake to a specific 
domain of free space. 

The range data may be generated from on-board sensors which 
emit and receive electro-magnetic/ultra-sonic radiation to determine the range 
and bearing of walls. 

The active contours to generate the desired path may be such 

that: 



WO 01/07976 PCT/AUOO/00882 

4 

i. the desired path must avoid walls and preferably minimise 
curvature. 

ii. the length and stiffness of the snake is a function of the vehicle 
and its state. 

5 iii. the "energy" of the snake is a defined function of the proximity to 

walls and its curvature. 

iv. if the "energy" exceeds a predefined limit, the velocity of vehicle 

is reduced and if the "energy" continues to exceed the limit for predetermined 
time/distance the vehicle is stopped. 
10 The driving hints to guide the snake along arcs and open areas 

may: 

i. modify speed according to local curvature and recommended 
speed limits. 

ii. add a "potential gradient energy" term to bias the position of the 
15 snake (i.e. keep left). 

The steering hints to guide the snake may be such that: 

i. radial rails are generated in front of the vehicle, 

ii. the rails are segmented into bands by the topology of the free 
space, 

20 iii. appropriate bands are selected by steering hints, and 

iv. snake vertices are fitted to selected bands. 

The desired path to generate steering demand and velocity may 
compare radius of curvature of vehicle, with radius of curvature of path. 

In another form, the invention resides in a means of localising 
25 the vehicle without localisation infrastructure comprising: 



(a) a means of establishing the or a starting position, 

(b) using dead-reckoning (ground speed, INS etc) to estimate the 
vehicle position, 

(c) using range data to find topology of free space in front of 
30 vehicle, 

(d) identifying changes in topology as landmarks (nodes), 

(e) matching said nodes to nodal-map to update vehicle position, 
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(f) using knowledge of position and nodal-map to pass driving hints 

to vehicle control, 

(9) using knowledge of position and nodal-path to pass steering 

hints to vehicle control. 

The dead-reckoning may be such that: 

i. vehicle position is defined as the approximate distance to the 
next node. 

». vehicle position is reset once a node has been passed. 

The range data to find topology of free space in front of vehicle 
may be such to: 

i- offset and re-scale data to front centre of vehicle. 

ii. smooth and re-sample range data. 

i". generate contour of equally spaced points. 

The identification of changes in topology as landmarks (nodes) 
may comprise: 

i. skeletonising free space. 

ii. pruning branches that are insignificant. 

iii. label remaining intersections as nodes. 

The matching of these nodes to nodal-map to update vehicle 
position may comprise: 

■■ ignoring nodes that are not expected (from nodal-map and 

position). 

»• matching based upon minimum radius, energy, and 

connectivity. 

The use of knowledge of position and nodal-map to pass driving 
hints to vehicle control may include, max-speed, gradient, curvature and wall 
profile. 

The use of knowledge of position and nodal-path to pass 
steering hints to vehicle control may include: 

the nodal-path containing a list of nodes that the vehicle must 
pass through; and 

ii. the steering hints consisting of turn-left, turn-right, stop, etc. 
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In another form, the invention resides in the creation of a nodal- 
map that contains: 

(a) position of landmarks (topological nodes, intersections). 

(b) topological relationship between nodes (distance, curvature, 
5 etc), 

(c) the nature of the arc that connects the nodes (driving hints). 

(d) a means where a nodal-map of the intended path and features 
is determined by driving the vehicle along the intended path, logging and 
processing the data obtained from all or any of the aforementioned sensors 

10 and storing the nodal-map along with the identifying characteristics of the 
nodes in memory. 

The nature of the arc that connects the nodes may be such to: 

i. account for physical limitations (i.e. gradient). 

ii. to improve the performance of the vehicle. 

15 iii. to account for unusual/dangerous conditions, i.e. wall-profile. 

iv. such hints will depend on the direction of travel. 

The means where a nodal-map of the intended path and 

features is determined by driving the vehicle along the intended path, logging 

and processing the data obtained from all or any of the aforementioned 
20 sensors and storing the nodal-map along with the identifying characteristics of 

the nodes in memory may comprise: 

i. A means where the dead-reckoning method is used to estimate 

the relative position of the nodes along the intended track in either the 
forward or reverse direction with respect to the vehicle. 
25 ii. A means where the range finding data is used generate a 

representation of the tunnel walls in the mine. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Various parts of the invention will be described with reference to 
the following drawings in which: 
30 Figure 1 illustrates a block structure of relative vehicle 

navigation system. 

Figure 2 illustrates absolute and relative navigation. 
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Figure 3 illustrates vehicle control with absolute navigation 

system. 

Figure 4 illustrates vehicle control with relative navigation 

system. 

5 Figure 5 illustrates an example of a nodal-map and nodal-path. 

Figure 6 illustrates possible tunnel geometries in which mid-line 
following is inappropriate. 

Figure 7 illustrates wall following with snakes. 
Figure 8 illustrates turning with snakes. 
10 Figure 9 illustrates skeletonisation of free space in front of a 

vehicle. 

Figure 10 illustrates a block diagram of the hardware required to 
automate a vehicle. 

Figure 1 1 illustrates graphical user interface, showing skeleton 
15 and snake at a Y junction. 

Figure 12 illustrates a side view of a LHD, showing laser 

sensors. 

Figure 13 illustrates an overhead view of a LHD, showing 
20 computer boxes. 

BEST MODE 

Vehicle control under RNS (see Figure 4) requires a nodal-map 
and a nodal-path (see Figure 5). Although the nodal-map is similar to the 
mine-map of the ANS, in that it contains information about the position of 

25 landmarks in the mine, it also contains information about the relative topology 
between the landmarks and driving hints. The position of these landmarks 
need only be approximate. For this reason they are referred to as nodes, and 
the network of nodes is referred to as a nodal-map. The nodal-path of the 
vehicle is then defined as a list of nodes that the vehicle must pass through. 

30 The vehicle is controlled by making changes to the heading and velocity to 
prevent the vehicle from hitting the walls. The walls are seen by on-board 
sensors. The absolute position of the vehicle is not critical to such control, 
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only the relative position of the vehicle with respect to the walls. The global 
position of the vehicle is estimated from dead-reckoning and node 
recognition. This knowledge is used to influence the behaviour of the vehicle 
control through hints (i.e. driving and turning strategies). 
5 With RNS, the vehicle is controlled by the actual free space in 

front of the vehicle. In this situation, the vehicle can move without any 
knowledge of the vehicle's global position. Although such knowledge may be 
redundant, it is not irrelevant. Without such knowledge, the vehicle may not 
choose the appropriate path at an intersection. Furthermore, knowledge of 

10 the vehicle's position allows the vehicle to operate at speeds higher (or lower) 
than the free-space would recommend (i.e. on long curves, or bumpy terrain). 

This split between control and localisation, highlights one of the 
main differences between ANS and RNS. In the ANS, vehicle control can only 
be achieved after the vehicle's absolute location has been established. The 

15 two routines are tied together; they are synchronous. The vehicle cannot be 
controlled if there is a problem with localisation. In many situations, the task of 
localisation can be very difficult. It can be computationally expensive (time 
consuming) and to make it robust, requires an excessive amount of 
redundant information. To improve the reliability of finding landmarks, 

20 infrastructure is added to the environment (e.g. reflecting beacons). 

In RNS, where the vehicle control and localisation have been 
"de-coupled", the vehicle control can run independently, and at a much higher 
bandwidth than the localisation. This is a desirable feature for autonomous 
vehicles. In practice, vehicle control is performed at a high bandwidth and is 

25 seen as a low-level process, whilst the localisation is the high-level process 
that can be performed at a much lower bandwidth. 

Since localisation is not critical to vehicle control, its reliability 
and robustness is less important. Thus, it may not be necessary to use any 
localisation infrastructure. In fact, it is possible to use natural features, such 

30 as intersection or comers, as landmarks. In particular, the features of free 
space topology in front of the vehicle are excellent landmarks. Of course, 
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since the RNS relies on the existence of walls to control the vehicle, it cannot 
"navigate" open space. 

In an embodiment, the nodal-map is a mathematical graph 
comprising nodes and branches (see left Figure 5). The nodal-path can be 
defined as a list of nodes that the vehicle must pass through (see right Figure 
5). For example, and referring to Figure 5, consider the plan to travel from 
Node A to Node G, via Nodes B, E and F. To navigate this path it is 
necessary to make decisions only at points B f E and F. In a computer 
implementation it would comprise multi-linked data-structures. The data- 
structures representing branches and nodes would be cross-linked. A hash 
table would be used to map textual node and branch names to the data- 
structure. 

The nodal-map can be constructed from a physical map of the 
mine, or it could be constructed by driving the vehicle along the intended 
path, logging and processing the data from the on-board sensors. Each node 
contains links and angles to connecting branches, whilst each branch 
segment contains: the length of the branch, links to both head and tail node 
and driving hints. 

These hints can include: a recommended maximum speed, 
curvature, gradient, and wall following strategies. These strategies are 
needed to deal with unusual tunnel profiles, such as those shown in Figure 6. 
The strategies might include: follow-left-wall, follow-right-wall, follow- 
centreline, etc. Curvature may be useful as a feed-forward signal for steering. 
The hints may also assist in segmentation/interpretation of the external 
sensor data (i.e. node recognition). 

The task of the Driver module (left-hand side of Figure 1) is to 
control the vehicle, to move it forward through the mine without hitting the 
walls and avoiding obstacles. The Driver module requires no knowledge of 
the location of the vehicle with respect to a global co-ordinate frame. The 
control module is given two demands from the Wall-Following module: speed 
(v) and steering angle (a). A dynamic model of the vehicle and the current 
vehicle state is required to convert this demand to vehicle control. 
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The task of the Wall-Following module (see Figure 1) is to 
generate a steering angle (a) to prevent the vehicle from hitting the wall with 
respect to the immediate walls within the mine. An analogy is a guided bus- 
way, where instead of rubber wheels on the side of the bus, a laser beam 
5 keeps the vehicle on track. 

In an embodiment a desired vehicle path needs to be 
constructed. This can be done with active contours (called snakes). A snake 
is a set of points (vertebra) that define a line, or spline (see Figure 7). The 
position of each vertebra is iteratively determined by minimising the energy of 

10 the snake. The snake has three energy terms: external, internal and potential. 
In this case, the external energy manifests itself as a repulsive force between 
the nodes of the snake and the wall. The internal energy manifests itself as a 
function of the curvature of the snake. The total length of the snake is a 
function of the speed of the vehicle, and its stiffness a function of the 

15 maximum turning circle of the vehicle. A potential energy function is added to 
account for hints supplied from the navigator (i.e. keep-left). To control 
turning, the snake can be excluded from regions of space (see Figure 8). This 
is done with hints from the navigator (i.e. turn left). 

It is important to note that there is no offset in this 

20 representation. This differs from ANS because the desired vehicle path is 
generated relative to the current position of the vehicle. This occurs because 
the "tail" of the snake is fixed to the current position of the vehicle. This 
technique has an added side effect, in that the energy of the snake is related 
in some manner to the difficulty of the path (i.e. either high curvature, or high 

25 external energy where the walls are very close). In either case, this energy 
can be used by the driver to slow the vehicle down. In fact, the possibility of 
collision can be monitored by keeping a record of the snake energy. 

In practice, if snakes are not well constrained they can become 
unstable. To improve the stability and robustness of the snake algorithm, the 

30 preferred embodiment of this routine is with fixed radial rails. In this method, 
each vertebra of the snake is placed on a different "rail" that is a fixed 
distance from the front of the vehicle (i.e. 1m to 15m). Each vertebra is then 
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free to move to the left or right, along the rail. Furthermore, given what is 
known about the free space in front of the vehicle it is possible to generate 
bands, which define the upper-bound and lower-bound position of the 
vertebra. Thus, given hints from the navigator, it is possible to select a band 
for turning (i.e. left band, right band). 

The task of the Navigator module (see right-hand side of Figure 
1) is to supply the Wall-Following module with instructions and hints based 
upon a nodal-path. To do this, the navigator must be able to estimate the 
position of the vehicle (Localization module). In the nodal representation, the 
position of the vehicle is described by the name of the current branch, and the 
distance to the next node. It can be estimated from: 

1- Dead-reckoning - determining the position of the vehicle with 

respect to its position at a different time by the application of vectors 
representing course and distance. 

2. Node recognition - being able to recognise the identity of a node 

(landmark) from external features in front of the vehicle - thus giving an 
estimate of the distance to the node. 

The task of node recognition is made simpler by the fact that: 
1- The nodes occur in a known sequence (e.g. A then B, then E 

and so on). 

2. The vehicle has an expectation of the next node to be 

encountered. 

3- The fact that decisions need to be made at these points implies 

that the geometry at these points is sufficiently rich to be identified from 
external sensor data (although it could be identified by some active or passive 
tag). 

For example, if a T-junction were expected then the node 
recognition software would be "looking" for a decrease in the free path 
distance ahead of the vehicle. If a left-hand branch were expected, the node 
recognition software would be "looking" for laser reflections from points to the 
left of the currently estimated left-hand wall. Once the vehicle has identified a 
node and is confident of the precise datum point (based upon laser and 
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measured features) and the vehicle position with respect to the datum, then 
the odometry can be reset ready for the next branch. Once the left turn has 
been made, a new branch is selected and the node recognition software 
algorithm starts looking for the next node. 
5 The identification of nodes (landmarks) based upon range data 

can be confused by noise and changes in orientation. To improve the 
robustness of this identification, the preferred embodiment of this routine is 
with a skeletonisation algorithm. This is a classical image processing 
algorithm that reduces a two dimensional shape into a curve with the same 

10 homotopy (see Figure 9). The skeleton is a powerful shape factor for feature 
recognition because it contains both topological and metric information. The 
topological values include the number of end points and the number of nodes 
where branches meet. The metric values are the mean length of branches 
and the angles of the branches. This closely duplicates the features in the 

15 nodal-map. One of the best features for recognition is the node radius - the 
distance from the node to the nearest wall. It has been found that end-nodes 
can be safely pruned if their radius overlaps their parent node. 

One method of implementation of the system according to the 
invention is to install it with an existing tele-operated vehicle control system. A 

20 typical tele-operation system requires a human operator to control the vehicle 
from a remote location via a conventional radio remote control system. Video 
images from vehicle-mounted cameras are used by the operator to guide the 
vehicle. 

The operator can control all of the necessary vehicle functions 
25 using joysticks and associated switches. The control commands are 
transmitted from a radio transmitter to the vehicle mounted receiver (see 
Figure 10). In this configuration, the control of the vehicle can be switched 
between the teleoperation (default) and automation. This implementation has 
a number of advantages: 
30 1 . There is only one point of control. 

2. All hardware necessary to control the vehicle already exists. 

3. The safety systems build into the tele-op systems can be used. 
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4. The vehicle can be switched back into tele-op mode. 

This last point is very useful during development. It means that 
the vehicle can be controlled remotely for operations that have not been 
automated (i.e. digging), and the vehicle can be recovered if the automation 
5 system fails. In this approach, an automated system works by duplicating the 
commands that would normally be sent by a human operator. This can be 
done in two ways: 

1 • off-board: duplicate the radio commands from the joystick, 

2. on-board: by-pass the radio receiver and communicate with the 

10 tele-op transducers and actuators (e.g. solenoid valves). 

Automation is achieved by examining the data from sensors, 
whether it be images from a TV camera or range data from laser scanners. 
To be able to perform automation off-board it is necessary for all of this 
sensor data to be transmitted over RF (Radio Frequency). Unfortunately, the 

15 underground environment is very poor environment for RF, and thus, the 
bandwidth for such information is very low. Since, a great deal of data is 
needed to navigate a vehicle at high speed, one solution is to place the 
automation system on-board. 

For the vehicle to be completely autonomous, all of the software 

20 and hardware necessary for navigation must reside on the vehicle itself. Of 
course, for control and safety reasons, a critical link in the control of the 
vehicle must be an external agent. In this case, it could be any type of 
computer (PC or laptop) that has radio contact with the vehicle (e.g. via radio 
modem). To improve the safety of such a system, whenever contact with this 

25 external agent is broken, software on the vehicle will bring the vehicle to a 
halt. Additionally, if radio contact for the teleoperation control system is lost, 
the vehicle will also be brought to a stop. The software and hardware 
elements in this control loop are implemented in a "fail-safe" configuration. 

Currently, calculations necessary for navigation are performed 

30 by two 200MHz Pentium processors (On Teknor VIPer821 half size PC/AT 
cards) connected to each other via an Ethernet LAN (Local Area Network). To 
achieve real-time performance the software can be installed on a real-time 
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multi-tasking operating system called LynxOS (posix compliant). The software 
has been written in ANSI C. To improve the flexibility of the system, the 
software has been decoupled into separate modules that communicate via 
RPC (remote procedure calls). Since RPC's can be made across the LAN, if 
5 more processing power is required, one or more of the software modules can 
be moved onto any number of processors. 

To help the development of the automation system each module 
has an associated RPC server, which can connect to a Tcl/Tk client (Tcl/Tk is 
a simple scripting graphics language). This client can be run on any laptop 

10 with an operating system that supports Tcl/Tk. An example of the graphical 
user interface (GUI) used to display the snake and skeleton is shown in 
Figure 11, where the vehicle is shown in the lower right corner, and the dark 
area represents the free space in front of the vehicle. Radial rails are 
generated in this free space at 1m intervals. Two paths are identified (left and 

15 right) with the skeletonisation of free space. The left-hand path is selected 
and the snake is restricted to the left-hand bands of the top four rails (13 to 
16). The arc that is labelled with numbers represents the position of the snake 
that has the minimum energy (curvature and repulsive force from walls). 
Although, the wall bias is not used in this example, it may have been useful to 

2 o shift the path to the left, to a hug" the left wall. 

A side view of the LHD is shown in Figure 12, showing the 
position of the Erwin SICK PLS's (Scanning Range Laser) front and rear. 
They have a range of 50m, with 0.5 degree angular resolution and a scanning 
angle of 180 degrees at 25 Hz. Communication with the CPU's is over a serial 

25 interface running at 500kbaud via a dedicated 68360 processor. In a 
production model these lasers would be lowered into protective boxes. An 
overhead view of the LHD is shown in Figure 13, showing the position of the 
two computers, and assorted power supplies etc. In a production model, most 
of these components can be packed into a single box. 

30 It should be appreciated that various changes and modifications 

can be made to the embodiments described without departing from the spirit 
and scope of the invention. 
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CLAIMS: 

1. A means of navigating without localisation infrastructure or 
external control, an autonomous vehicle along a path that is confined by walls 
that are within range of on-board sensors by determining the relative location 
and orientation of the walls with respect to the vehicle, the means comprising 
means of controlling the vehicle, including setting steer angle and ground 
speed, without localisation comprising hardware and means to: 

(a) use range data to establish free space in front of vehicle, 

(b) use active contours (or snakes) to generate a desired path, 

(c) use driving hints to guide the or a said snake, for instance along 
arcs and open areas, and/or to 

(d) use steering hints to confine the snake to a specific domain of 
free space, for instance at intersections, and 

(e) use desired path to generate steering demand and velocity. 

2. The means of claim 1, wherein the range date is in the form of 
on-board sensors which emit and receive electro-magnetic/ultra-sonic 
radiation to determine the range and bearing of walls. 

3. The means of claim 1 , wherein the active contours (or snakes) 
to generate the desired path are such that: 

(a) the desired path must avoid walls and preferably minimise 
curvature, 

(b) the length and stiffness of the snake is a function of the vehicle 
and its state, 

(c) the "energy" of the snake is a defined function of the proximity to 
walls and its curvature, 

(d) if the "energy" exceeds a predefined limit, the velocity of vehicle 
is reduced and if the "energy" continues to exceed the limit for predetermined 
time/distance the vehicle is stopped. 

4. The means of claim 1, wherein the driving hints to guide the 
snake along arcs and open area are adapted to: 

(a) modify speed according to local curvature and recommended 

speed limits, 
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(b) add a "potential gradient energy" term to bias the position of the 

snake (i.e. keep left). 

5. The means of claim 1 , wherein the steering hints to guide the 

snake are such that: 
5 (a) radial rails are generated in front of the vehicle, 

(b) the rails are segmented into bands by the topology of the free 
space, 

(c) appropriate bands are selected by steering hints, and 

(d) snake vertebra are fitted to selected bands. 

10 6. The means of claim 1, wherein the desired path to generate 

steering demand, and velocity compares the radius of curvature of vehicle, 
with radius of curvature of path. 

7. A means of localising a vehicle without localisation infrastructure 
comprising: 

15 (a) a means of establishing the or a starting position, 

(b) using dead-reckoning (ground speed, INS etc) to estimate the 
vehicle position, 

(c) using range data to find topology of free space in front of 
vehicle, 

20 (d) identifying changes in topology as landmarks (nodes), 

(e) matching said nodes to nodal-map to update vehicle position, 

(f) using knowledge of position and nodal-map to pass driving hints 
to vehicle control, 

(g) using knowledge of position and nodal-path to pass steering 
25 hints to vehicle control. 

8. The means of claim 7, wherein the dead-reckoning is such that: 

(a) vehicle position is defined as the distance to the next node, 

(b) vehicle position is reset once a node has been passed. 

9. The means of claim 8, wherein the range data to find topology 
30 of free space in front of vehicle is such to: 

(a) offset and re-scale data to front centre of vehicle, 

(b) smooth and resample range data, 



WO 01/07976 



17 



PCT/AUOO/00882 



(c) generate contour of equally spaced points. 

10. The means of claim 9, wherein the identification of changes in 
topology as landmarks (nodes)comprises: 

(a) skeletonising free space, 

(b) pruning branches that are insignificant, 

(c) label remaining intersections as nodes. 

11. The means of claim 10, wherein the matching of these nodes to 
nodal-map to update vehicle position comprises: 

(a) ignoring nodes that are not expected (from nodal-map & 
position), 

(b) matching based upon minimum radius, energy, and 
connectivity. 

12. The means of claim 11, wherein the use of knowledge of 
position and nodal-map to pass driving hints to vehicle control includes, max- 
speed, gradient, curvature and wall profile. 

13. The means of claim 12, wherein the use of knowledge of 
position and nodal-path to pass steering hints to vehicle control includes: 

(a) the nodal-path containing a list of nodes that the vehicle must 
pass through; and 

(b) the steering hints consisting of turn-left, turn-right, stop, and the 
like. 

14. A nodal-map for use with means of localising a vehicle without 
localisation infrastructure, the nodal map comprising: 

(a) position of landmarks (topological nodes, intersections), 

(b) topological relationship between nodes (distance, curvature, 
and the like), 

(c) the nature of the arc that connects the nodes (driving hints), 

(d) a means where a nodal-map of the intended path and features 
is determined by driving the vehicle along the intended path, logging and 
processing the data obtained from all or any of the aforementioned sensors 
and storing the nodal-map along with the identifying characteristics of the 
nodes in memory. 
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15. The map of claim 14, wherein the nature of the arc that 
connects the nodes is such to: 

(a) account for physical limitations (i.e. gradient), 

(b) to improve the performance of the vehicle, 

5 (c) to account for unusual/dangerous conditions, i.e. wall-profile. 

16. The map of claim 15, wherein the means where a nodal-map of 



the intended path and features is determined by driving the vehicle along the 
intended path, logging and processing the data obtained from sensors and 
storing the nodal-map along with the identifying characteristics of the nodes in 
l o memory which comprise: 

(a) a means where the dead reckoning method is used to estimate 
the relative position of the nodes along the intended track in either the 
forward or reverse direction with respect to the vehicle, 

(b) a means where the range finding data is used generate a 
15 polyline of the mine. 

17. A method for navigating a vehicle, the method comprising 

creating active contours (or snakes) to generate a desired path for the 
vehicle, using driving hints to guide the or a said snake and/or using steering 
hints to confine the snake to a specific domain of free space. 

20 



WO 01/07976 



PCT/AU00/00882 



1/5 



Range Sensors 

J I 



Vehicle Sensors 




Vehicle Control Vehicle Position 

Figure 1 : Block Structure of relative vehicle navigation system. 
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Figure 2: Absolute (a) and Relative (b) navigation. 
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Figure 3: Vehicle Control with Absolute Navigation System (ANS). 
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Figure 4: Vehicle Control with Relative Navigation System (RNS). 




Figure 5: An example of Nodal-Map and Nodal-Path from A to G. 




Figure 6: Possible tunnel geometries, in which mid-line following is inappropriate. 
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Figure 7: Wall following with snakes. 




Figure 8: Turning with snakes. 




Figure 9: Skeletonization of free space in front of vehicle. 
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Figure 1 1 : Graphical user interface, showing skeleton and snake at Y-junction. 
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Figure 13: Overhead view of LHD, showing computer boxes. 
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